Portable electronic equipment with automatic control to keep display turned on and method

ABSTRACT

Apparatus and method provide a hold on function in a mobile phone or other portable electronic equipment keeps the display thereof turned on in spite of a screensaver or other power saving feature while a user is reading or watching the display and allows activating of power saving facilities of the mobile phone or equipment only when a user no longer is reading or watching the display. Also, a computer program product stored in a storage medium, includes a storage medium, a computer program including face recognition software to recognize whether an input image represents that of a human face, and a control program to control operation of portable electronic equipment depending on whether or not an input image represents a human face.

TECHNICAL FIELD

The present invention relates generally, as indicated, to portableelectronic equipment with automatic control to keep display turned on(held in an on mode) and method, and, more particularly, to apparatusand method to hold a display turned on in response to an image.

BACKGROUND

Many portable electronic devices, such as, for example, mobile phones,hand-held computers, personal digital assistants (PDAs), etc., havedisplays (sometimes referred to as screens or display screens) on whichvarious images, information, text, icons, etc., may be shown. Many ofsuch devices also have a screensaver (also referred to as a screensaverfunction) that activates after a period of time to turn off or to blankthe display of the device or to present a standard image such as thename of the device manufacturer or of the wireless carrier or a standardGUI (graphical user interface), etc. Screensavers are useful for anumber of reasons, e.g., to conserve power, to avoid showing informationthat might be seen by an unauthorized person, etc. For example, ascreensaver may turn off the display if the user of the device does notprovide within a specified period of time a conventional input to thedevice, e.g., by manually or otherwise pressing a key, operating acursor, such as a navigation/function selection key (referred to belowas a navigation key for brevity), pointer, trackball or touch pad, ortouching a stylus or a finger to a touch sensitive display screen, etc.

Sometimes a screensaver may activate at an inconvenient moment or time.For example, a screensaver may activate to blank a display while a useris looking at the image on the display, e.g., while reading a lengthytext or document shown on the display or while studying a map, pictureor other image shown on the display. The user would have to reactivatethe display or to stop the effect of the screensaver by providing aconventional input to the device; and having to do this once orsometimes several times may be an inconvenience.

SUMMARY

According to an aspect of the present invention, portable electronicequipment, includes a camera, a display, and circuitry adapted to effectat least one of turning on or holding on the display in response torecognizing a specified image provided by the camera.

Another aspect relates to the circuitry including face recognitionsoftware adapted to recognize characteristics of a human face as thespecified image.

Another aspect relates to the circuitry being adapted to effect a powersaving mode for the display in the absence of a human face being seen bythe camera.

Another aspect relates to at least one of the display or circuitryhaving a screensaver function for the display, and the circuitry beingadapted to override the screensaver function at least while a human faceis recognized as the specified image.

Another aspect relates to the screensaver function effects a powersaving mode for the display after expiration of a period of time that noinput has been provided the equipment, and circuitry prevents expirationof the time period at least while the specified image is recognized.

Another aspect relates to the circuitry being adapted to prevent suchexpiration of the time period for a duration after the specified imagehas been recognized.

Another aspect relates to the camera being located in the equipment toface in a direction to view the face of a user of the equipment whilethe user is viewing the display.

Another aspect relates to a fish eye lens for the camera to obtain awide angle view to facilitate receiving an image of the face of a userof the equipment.

Another aspect relates to the fish eye lens having a focal length toprovide to the camera a relatively focused image of the face of a userwhile such user holds the equipment in a hand during use of theequipment.

Another aspect relates to the equipment comprising a mobile phone, andthe camera comprising a standard camera of the mobile phone.

Another aspect relates to including a second camera for takingphotographs by the equipment.

Another aspect relates to the circuitry including program code adaptedto recognize a prescribed image from the camera and adapted to controloperation of a power saving feature associated with the display inresponse to whether or not the prescribed image is recognized.

Another aspect relates to the circuitry including operational controlcircuitry for operating the portable electronic equipment and a memoryadapted to store information and to provide for retrieval of informationand program code for use in connection with operation of the portableelectronic equipment, and further including an input module to provideuser inputs to the operational control circuitry.

Another aspect relates to the portable electronic equipment being amobile phone, and further including a communications module adapted towirelessly transmit and receive signals, a speaker, and a microphone.

Another aspect relates to a method of operating portable electronicequipment, including detecting whether a specified image is received bya camera of the equipment, and operating the equipment in response towhether or not the specified image is received.

Another aspect relates to the detecting including detecting whether theimage of a human face is received.

Another aspect relates to the operating including controlling operationof a display of the equipment.

Another aspect relates to the controlling including determiningoperation of a power saving feature of the display.

Another aspect relates to the portable electronic equipment being amobile phone, the detecting including detecting whether the image of aface is received by a camera of the mobile phone, and the operatingincluding effecting control or overriding of a screensaver for a displayof the mobile phone.

Another aspect relates to a computer program product stored in a storagemedium, including a storage medium and a computer program including facerecognition software to recognize whether an input image represents thatof a human face, and a control program to control operation of portableelectronic equipment depending on whether or not an input imagerepresents a human face.

Another aspect relates to keeping the display of portable electronicequipment, e.g., a mobile phone, PDA or the like, turned on while a useris reading or watching the display of the equipment and to activatepower saving facilities of the equipment only when a user no longer isreading or watching the display.

Another aspect relates to not activating power saving facilities of adisplay while there is a human face in front of the device that includesthe display, e.g., a person reading or watching the display.

Another aspect relates to automatically turning on a display when a facecomes within detection range and/or view of the display or a cameraassociated with the display.

Another aspect relates to automatically turning on a display when a faceis detected as being seen by a camera associated with the display sothat a user would not have to press a button or otherwise provide aninput to a device including the display to turn on the display.

According to another aspect, a mobile phone automatically turns off oron a screensaver for the display of the mobile phone depending onwhether or not there is a face in front of the display.

These and further features of the present invention will be apparentwith reference to the following description and attached drawings. Inthe description and drawings, particular embodiments of the inventionhave been disclosed in detail as being indicative of some of the ways inwhich the principles of the invention may be employed, but it isunderstood that the invention is not limited correspondingly in scope.Rather, the invention includes all changes, modifications andequivalents coming within the spirit and terms of the appended claims.

Features that are described and/or illustrated with respect to oneembodiment may be used in the same way or in a similar way in one ormore other embodiments and/or in combination with or instead of thefeatures of the other embodiments.

It should be emphasized that the term “comprises/comprising” when usedin this specification is taken to specify the presence of statedfeatures, integers, steps or components but does not preclude thepresence or addition of one or more other features, integers, steps,components or groups thereof.

Many aspects of the invention can be better understood with reference tothe following drawings. The components in the drawings are notnecessarily to scale, emphasis instead being placed upon clearlyillustrating the principles of the present invention. To facilitateillustrating and describing some parts of the invention, correspondingportions of the drawings may be exaggerated in size, e.g., made largerin relation to other parts than in an exemplary device actually madeaccording to the invention. Elements and features depicted in onedrawing or embodiment of the invention may be combined with elements andfeatures depicted in one or more additional drawings or embodiments.Moreover, in the drawings, like reference numerals designatecorresponding parts throughout the several views and may be used todesignate like or similar parts in more than one embodiment.

BRIEF DESCRIPTION OF THE DRAWINGS

In the annexed drawings:

FIG. 1 is a schematic illustration of the front of a portablecommunication device, e.g., in the form of a mobile phone;

FIG. 2 is a schematic side elevation view of the mobile phone looking inthe direction of the arrows 2-2 of FIG. 1;

FIG. 3 is a schematic block system diagram of circuitry of the portabletelephone for carrying out operation thereof in a manner describedbelow;

FIG. 4 is a schematic flow chart illustrating exemplary logic accordingto which the invention may operate using a hold on function to preventthe screensaver function from turning off the display of the mobilephone;

FIG. 5 is a schematic flow chart illustrating exemplary logic accordingto which the invention may operate using an image to enable the mobilephone or one or more functions of the mobile phone;

FIG. 6 is a schematic flow chart illustrating setting up of the hold onfunction of the mobile phone; and

FIG. 7 is a schematic side elevation view similar to FIG. 2 of analternate embodiment of mobile phone using a single camera for the holdon function and for photographing function.

DESCRIPTION

As used herein, the term “portable communication device” includesportable radio communication equipment. Portable communication deviceand mobile communication device may be used synonymously. The term“portable radio communication equipment,” which may be referred to belowas a portable phone (or as portable telephone, mobile phone or mobiletelephone), a portable device, a portable radio terminal or a portableterminal, includes all electronic equipment, including, but not limitedto, mobile telephones, pagers, communicators, i.e., electronicorganizers, smartphones, personal digital assistants (PDAs), or thelike. While the present invention is being discussed with respect toportable communication devices, it is to be appreciated that theinvention is not intended to be limited to portable communicationdevices, and can be applied to any type of electronic equipment capableof being used for voice and/or data communication.

As will be appreciated, the invention may be used with portabletelephones, other telephones, personal digital assistants (PDA),computers, other communication devices, etc.; for brevity, the inventionwill be described by way of example with respect to portable telephones,but it will be appreciated that the invention may be used with othercommunication devices.

Referring in detail to the drawings, and initially to FIGS. 1 and 2, aportable communication device in accordance with an embodiment of thepresent invention is illustrated generally at 10. The portablecommunication device 10 will be referred to below as a mobile phone.However, as was mentioned above, reference to “mobile phone” includesvarious other devices, such as, for example, those mentioned above. Inoutward appearance, for example, as is illustrated in FIG. 1, the mobilephone is of one type of design or style; however, the features of theinvention, as are described in further detail below, may be used inother types of mobile phones, such as those that include cases that openand close (sometimes referred to as a “flip phone”), and various othermobile phones that currently exist or may come into existence in thefuture.

The mobile phone 10 includes case (housing) 11, speaker 12, microphone13, display 14, e.g., liquid crystal display, light emitting diodedisplay, or other display, on/off switch 15, and a number of keysgenerally indicated at 16. The keys 16 may include a number of keyshaving different respective functions. For example, the key 20 may be anavigation key, selection key or some other type of key; the keys 21, 22may be, for example, soft switches or soft keys; and the keys 23 may bedialing keys. As an example, the navigation key may be used to scrollthrough lists shown on the display 14, to select one or more items shownin a list on the display 14, etc. The soft switches 21, 22 may bemanually operated to carry out respective functions, such as those shownor listed on the display 14 in proximity to the respective soft switchor selected by the navigation key 20, etc. The dialing keys 23 may beused to dial a telephone number or to input alphanumeric or other data.The speaker 12, microphone 13, display 14, and keys 16 may be used andfunction in the usual ways in which a mobile phone typically is used,e.g. to initiate, to receive and/or to answer telephone calls, to sendand to receive text messages, to connect with and carry out variousfunctions via a network, such as the Internet or some other network, tobeam information between mobile phones, etc. These are examples; theremay be other uses that currently exist or may exist in the future. Themobile phone 10 also includes operating circuitry 24 that responds toprogramming and to inputs, e.g., provided by a user pressing a key orapplying a stylus or finger to a touch-sensitive screen, etc. orprovided from an external source, such as an incoming telephone call ortext message, to carry out functions of the mobile phone. One of thosefunctions may be a screensaver function, e.g., as was described above.

The mobile phone 10 includes a “hold on” feature that holds, keeps ormaintains, etc. the display 14 in an on mode, e.g., turned on, poweredon, etc., to continue displaying an image even after a time period thatthe screensaver function ordinarily would activate and, for example,turn off the display 14. The hold on feature may be carried out based onan image, for example, an image that is received by the mobile phone 10,e.g., by a camera 30. For example, the image may be that of the face ofthe user of the mobile phone. The camera 30 in cooperation withcircuitry may sense that the user is looking at the display 14; andbased on that image, the hold on feature would activate to hold thedisplay on, e.g., to keep the screensaver from turning off the display.Therefore, while the user continues to look at the display and the imageof the user is picked up by the camera 30, the hold on feature keeps thedisplay on to continue to show information, etc., to the user withoutthe user having to provide a conventional input to the mobile phone 10to keep the display turned on.

In an embodiment the hold on feature may instead or additionally be aturn on feature to turn on the display 14 of the mobile phone inresponse to the mentioned image being picked up, e.g., received, sensed,etc., by the camera 30. Such feature also may be used to turn on themobile phone, to answer an incoming telephone call, to initiate atelephone call, to receive or to send a text message, etc.

The camera 30 is arranged in the mobile phone 10 to receive or to obtainan image from a direction toward which the front 31 of the mobile phoneis facing. For example, while holding the mobile phone in his/her hand,a user typically would look at the display 14 and/or at the keys 16 thatare at the front 31 of the mobile phone to see an image on the display,to dial a telephone number, to select an icon shown on the display, toinput text for a text message, etc. The camera 30 is arranged to pickup, to receive, to see, to view, etc., the user while the user islooking at the front 31 of the mobile phone.

Sometimes a user may look at the display 14, e.g., to read text, to viewa picture, etc., for a relatively long time. The image of the viewer isreceived by the camera 30 while the user is looking at the display, andcircuitry and associated programming may respond to the camera responseto the image, e.g., the camera output, to prevent the screensaverfunction from removing what is being shown on the display. When theimage of the viewer no longer is received by the camera the hold onfeature may stop preventing the screensaver function from operating inits usual manner, either immediately or after a delay time, such as, forexample, the typical delay time of the screensaver or some other delaytime that allows the camera to reacquire the image of the user.

The camera 30 may be the same type of camera typically used in a mobilephone or it may be another type of camera. The field of view andfocusing characteristics of the camera 30 may be selected to receive asuitable image of a user, e.g., of the user's face, of suitable qualityand focus so that the circuitry is able to discern that a user islooking at the mobile phone display 14, for example, while the mobilephone is held in the user's hand at a typical range of distances fromthe user's face and eyes (for viewing the display).

In an embodiment, the mobile phone 10 may include two cameras, e.g., thecamera 30 that faces in a front direction from the front 31 of themobile phone 10, and another camera 32 that faces in a back direction,e.g., from the back 33 of the mobile phone. As an example, the camera32, display 14, and navigation key 20 may be used in a conventionalmanner to take a picture, e.g., the view seen by the camera 32 may beshown on the display 14 while the user views that image and as desiredselectively presses the navigation key to store the desired picture inmemory. In another embodiment the mobile phone 10 may include only onecamera and suitable optical elements and/or light paths to provide tothe camera views that would be seen by both the mentioned cameras 30,32. For example, in such embodiment the operating circuitry 24 mayrespond to a user input to operate in photographing mode, and in suchcase the optical elements may allow the image received from the back 33of the camera to be received by the camera. However, if the mobile phoneis operated in a different mode, e.g., a mode that is not one intendedto take photographs, the optical elements may prevent the image from theback 33 from reaching the camera sensor and instead may provide an imagefrom the front 31 of the mobile phone to impinge on the camera sensor.The optical elements may include one or more of various devices, suchas, for example, movable mirrors of the type used in a single lensreflex camera to determine the path to which incoming light is directed,light shutters that open or close respective light paths to the camera,beam combiners (also known as beam splitters), etc. Fiber optics,reflectors, lenses, etc., may be used to direct images from the front 31or from the back to the camera.

If a user were holding the mobile phone in his or her hand while lookingat text shown on the display 14, the camera may view or see the user,e.g., the face of the user. The camera 30 has associated optics andelectronics, e.g., lenses, sensors, such as a ccd (charge coupleddevice) or other light sensitive device, etc., to pick up an image ofthe user or whatever else is picked up by the camera lens. The camera 30may be similar to or the same as a typical camera used in conventionalmobile phones that have a camera function.

Turning to FIG. 3, a schematic block system diagram of operatingcircuitry 24 of the mobile phone 10 is illustrated. The illustration isexemplary; other types of circuitry may be employed in addition to orinstead of the operating circuitry 24 to carry out the various functionsof a mobile phone and the various functions described in detail herein.The operating circuitry includes an operational control 40 that controlsthe various components of the operating circuitry 24. An input module 41provides inputs to the operational control 40, such as, for example,inputs from the various keys 16. Inputs also may be provided from thedisplay 14 if it is a touch screen type of display, and inputs also maybe provided the input module 41 from other connections to the mobilephone, etc. The display 14 may be a touch screen that provides forinputs to the input module 41 by touching using a finger, a stylus, orsome other device, and the result of such touching may be provided asinputs to the operational control 40. The operational control 40 alsomay operate the display 14 to determine what information, icons, images,etc. is shown on the display 14.

A camera module 42 is coupled to and operates in response to theoperational control 40. The camera module 42 also is coupled to thecamera 30 and, if used, also to the camera 32. Electrical power isprovided by the operational control 40 to the camera 31, and the cameraprovides to the operational control image data representing the imageseen by or impinging on the camera. Program code in the operatingcircuitry 24, e.g., stored in the memory 43, may control operation ofthe operational control 40 to assess the image data received from thecamera module to determine whether that image data is recognized asrepresentative of a human face. Image recognition computer programs arecommercially available and among those are face recognition computerprograms. In an embodiment of the invention the parameters associatedwith or used in connection with a suitable face recognition program neednot be tightly constrained so as to recognize a particular face of aparticular person. Rather, the parameters may be relatively loose orbroad-based so as to allow the face recognition program to recognizevirtually any human face without regard to who is the person belongingto the face.

As an example, the operational control 40 may be a microprocessor orsome other electrical or electronic device that is responsive to variousinputs, e.g., input signals, and provides various outputs, e.g., outputsignals. The operational control 40 may be internally programmed ormanufactured in a way to include internal programming thereof to carryout various functions. However, in many instances an operational control40 of a mobile phone 10 would have associated therewith the memory 43 inwhich appropriate programming instructions, computer program, logic,etc., may be provided the operational control 40 to carry out thefunctions thereof. The memory 43 also may include storage for telephonenumbers and other information concerning contacts who may be called,messaged, etc. using the mobile phone 10, storage of photographs and/orother data, as often is the capability of such memory in conventionalmobile phones, for example, and the memory may be used for otherpurposes that may come into existence in the future. The memory 43 maybe a read only memory, random access memory (RAM), flash RAM,programmable read only memory, or some other memory device. Alsoassociated with the operational control 40 is a timer 44 that can beused to provide timing signals representing increments of time forsynchronizing operation of the operating circuitry 24 with some otherdevice, for clock/calendar control functions, and/or for determiningamount of time (duration) for the hold on function and/or for thescreensaver function, as is described herein.

The operating circuitry 24 also includes a communications module 45 thatreceives inputs from microphone 13 and provides outputs to the speaker12, as are common functions in a mobile phone. An antenna 46 may becoupled to the communications module 45 to transmit and to receivesignals representing telephone communications, data communications,messages, etc. The communications module 45 may operate under control ofthe operational control 40 in the usual manner of a mobile phone.Additionally, the communications module 45 may provide an input to theoperational control 40 to indicate that there is an incoming telephonecall or text message; and in response thereto, the operational control40 may operate the display 14 in conventional manner, e.g., to indicatean incoming phone call, to show a text message or photograph, etc.

A power supply 47 provides electrical power to the operating circuitry24 and/or to other parts of the mobile phone 10 via the on/off switch15. The power supply may be a conventional battery or some other sourceof electrical power. Upon closing the on/off switch 15, the power isprovided the operating circuitry 24 to carry out the various functionsdescribed herein, for example. If desired, closing the switch 15 maylead to temporary operation of the display to display a start-up messageor indication, and then a power saving feature, e.g., a screensaverfunction, may be implemented to turn off the display until a specifiedimage, e.g., one suitably resembling a human face, is seen by the camera30 and the operational control 40 of the operating circuitry 24recognizes the specified image. As was mentioned elsewhere herein, thehuman face need not be of a specific person but rather is more generic.In another embodiment the display may remain off upon closing of theswitch 15 until the operational control recognizes the specified image,e.g., a human face.

A computer program flow chart or logic diagram is illustrated at 50 inFIG. 4. Such flow chart 50 represents functions that may be carried outin the operating circuitry 24 in carrying out an embodiment of theinvention as an example. The functions illustrated in FIG. 4 anddescribed herein may be provided the operating circuitry as a computerprogram, for example, that is written in appropriate computer languageor logic format to carry out the various steps described. A personhaving ordinary skill in the art would be able to write such program tocarry out the steps and functions illustrated and described here. Itwill be appreciated that the program code may be stored in a storagemedium. For example, as is described further below, the program code mayinclude a computer program including face recognition software torecognize whether an input image represents that of a human face, and acontrol program to control operation of portable electronic equipmentdepending on whether or not an input image represents a human face.

Initially the portable electronic equipment, e.g., mobile phone 10, isturned on at block 51, for example, by closing the on-off switch orpower switch 15, and the mobile phone, including the operating circuitry24 is initialized at block 52. Initialization functions are carried outin many types of electronic equipment and will depend on the variousfunctions, capabilities, etc. of the equipment, as is known. At block 53the display 14 may be turned on by the operating circuitry 24, forexample. At block 54 a screensaver timer is started or is restarted; thetimer may be the timer 44 in conjunction with the operational control40; for example, the timer 44 provides timing signals that are countedor otherwise aggregated by the operational control until a prescribedtime period has been determined. At block 55 an inquiry is madc whetherthe time period for the screensaver has timed out. A loop is followed at56 until time out has occurred at timer block 55, for example.Ordinarily in some prior screensaver circuits or displays withscreensavers, if the screensaver timer has timed out, the screensavermay provide various modes for the mobile phone display, etc., such as bythe power saving feature of the screensaver being put into effect, e.g.,by blanking the display, turning off energy to the display or to part ofthe display, e.g., to the backlight that may be illuminating a liquidcrystal display, etc., or by providing a prescribed image on thedisplay, such as the name of the manufacturer of the mobile phone, themobile phone carrier, etc. or a graphical user interface (GUI) image.

In accordance with the described embodiment of the invention, though,the screensaver feature may be blocked or prevented from entering thepower saving mode or some similar mode or having an effect on thedisplay 14, etc. by the hold on feature of the invention. At block 57the hold on camera image is checked. For example, the operationalcontrol 40 may check the camera 30 to determine whether an image isbeing received and, if so, to load the image data, for example, into theoperational control 40 or into memory 43. At block 58 an inquiry is madewhether image data received from the camera 30 is recognized as aspecified image. For example, does the image look like a face of a humanbeing? For this purpose image recognition software in the operatingcircuitry may be used, as was mentioned above. If the answer is yes,then a loop 59 is followed back to block 54 to restart the screensavertimer, and the logic subsequently flows back through blocks 55-58 andloop 59 again without turning on the screensaver or power saving featureuntil the image no longer is recognized as the specified image.

At block 58 if the image received from the camera 30 is not a specifiedimage, e.g., an image of a human face, then the logic would flow via atimer 60 to block 61, to effect or to implement a screensaver function.Effecting or implementing the screensaver function would turn off thedisplay 14 or would reduce power to the display to saver power for themobile phone or other portable electronic equipment in which thefeatures of the invention are used. The timer 60 represents an inquirywhether the specified image had not been recognized for more than thetime set in the timer 60, e.g., in case the user were to turn his or herhead briefly away from the camera 30 or has turned the phone away fromhis or her face, etc., while still holding the mobile phone 10 in his orher hand and desiring still to continue observing the image shown on thedisplay. Thus, if the timer 60 has not yet timed out, loop 62 isfollowed back to block 58 where inquiry is made to determine whether theimage data received from the camera 30 represents a specified image. Ifit does, then loop 59 is followed; if it does not, then the flow chartflows to timer block 60 again. If the timer 60 has timed out without theimage from the camera 30 being recognized at block 58 as a specifiedimage, then at block 61 the power saving feature of the screensaver,etc., is implemented.

It will be appreciated that the description of the above embodimentpresents the hold on feature as restarting the screensaver timer. Italso may be said that the hold on feature disables, blocks, overrides orprevents operation of the screensaver or other power saver function ofthe mobile phone 10. Furthermore, in an embodiment of the invention thescreensaver or power saver function of the mobile phone may not be quiteas distinct from the hold on function; in such case, for example, thehold on function may keep the display 14 turned on as long as there arecognized specified image received by the camera 30 and recognized bythe operational control, but when there no longer is such recognizedimage seen by the camera 30, the hold on function may cause theoperational control 40 to turn off the display 14 or to otherwise causeit to go into a power saving mode.

In FIG. 4 at block 63 an inquiry is made to determine whether aconventional input has been received by the input module 41. Suchconventional input may be, for example, a user pressing a key 16,touching a touch sensitive display 14, etc., or an external input isreceived, e.g., an incoming telephone call or text message. At block 63there may be a constant looking for such a conventional input as loopline 64 is followed unless such conventional input is detected. If suchconventional input is detected, then an interrupt type function may beprovided via line 65 to the flow chart logic 50 to turn on the display14 at block 53, and then the logic may follow as was described above. Ifsuccessive conventional inputs are detected at block 63 before anytiming out by the timers 55 and 60, for example, the display will remainturned on.

Another flow chart or logic diagram 70 is shown in FIG. 5. The flowchart 70 represents steps to enable the mobile phone 10 or otherportable electronic equipment. At block 71 the mobile phone is turnedon, e.g., by the switch 15. At block 72 the hold on camera 30 isinitialized to respond to images or scenes provided to or viewed by thecamera. At block 73 the hold on camera 30 is checked to read the imagedata from it. At block 74 an inquiry is made whether the imagerepresented by image data received from the camera 30 is a specifiedimage. In this case if the specified image is set to be relativelyloosely defined, e.g., as substantially any human face, then uponrecognizing any human face at block 75 the mobile phone 10 is enabledfor use. If at block 74 the input image data is not recognized as aspecified image, then loop 76 is followed until a specified image isreceived. It is necessary to receive a specified image before the mobilephone 10 can be enabled at block 75. Furthermore, as is represented bythe connection AA between the flow charts 70 of FIGS. 5 and 50 of FIG.4, if desired after the mobile phone 10 has been enabled at block 75,then the steps from blocks 54-61 of FIG. 4 may be carried out.Alternatively, there may be no connection between the flow charts 50 and70; and in such case the mobile phone 10 simply may be enabled by thesteps in flow chart 70, after which other standard operation of themobile phone may be carried out.

Briefly referring to FIG. 6, a hold on set up flow chart or logic 80 isillustrated. Such flow chart shows an example of how images may bestored in the operating circuitry 24, e.g., in memory 43 or elsewhere,for comparison to determine whether an image seen by the camera 30 is aspecified image. At block 81 the set up function for the hold on featureis selected. This may be a setup function of the mobile phone. At block82 an input photo is taken using the camera 30, for example. The imagemay be provided in some other way. At step 83 the image is stored, e.g.,in memory 43 so that it would be available when the image comparison orrecognition step is carried out at step 58 in flow chart 50 and step 74in flow chart 70. The steps 81-83 of flow chart 80 may be carried outfor several persons (individuals) to obtain average reference datarepresenting faces, e.g., a generic face, for use in effecting the holdon feature, for example.

Briefly referring to FIG. 7, another mobile phone 10′ is illustrated.The mobile phone 10′ is similar to the mobile phone 10 except that thereis one connection 90 between the operating circuitry 24 and both cameras30, 32. Also, there is a fish eye lens 91 in front of the camera 30 toprovide a wider field of view for that camera than ordinarily would beavailable from a more conventional camera lens. The fish eye lens allowsfor the face of the user to be at various locations from directly infront of the mobile phone to off to a side, top or bottom of the mobilephone while the image data provided by the camera still may besufficient to be considered a specified image for the above describedfunctions. The mobile phone 10′ may have in the operating circuitry 24selection functions to allow the user to select whether to use themobile phone in photographing mode to use the camera 32 to takephotographs for storage in memory 43, for example. In such photographicmode it is possible that an image from the hold on camera 30 also may beprovided the operating circuitry 24 to assure that the mobile phonedisplay does not time out and/or to assure that the user is anauthorized user, as was described above. When the user selects operationof the mobile phone 10′ in other than photographing mode, the operatingcircuitry 24 may turn off the camera 32 to save power.

It will be appreciated that portions of the present invention can beimplemented in hardware, software, firmware, or a combination thereof.In the described embodiment(s), a number of the steps or methods may beimplemented in software or firmware that is stored in a memory and thatis executed by a suitable instruction execution system. If implementedin hardware, for example, as in an alternative embodiment,implementation may be with any or a combination of the followingtechnologies, which are all well known in the art: discrete logiccircuit(s) having logic gates for implementing logic functions upon datasignals, application specific integrated circuit(s) (ASIC) havingappropriate combinational logic gates, programmable gate array(s) (PGA),field programmable gate array(s) (FPGA), etc.

Any process or method descriptions or blocks in flow charts may beunderstood as representing modules, segments, or portions of code whichinclude one or more executable instructions for implementing specificlogical functions or steps in the process, and alternate implementationsare included within the scope of the preferred embodiment of the presentinvention in which functions may be executed out of order from thatshown or discussed, including substantially concurrently or in reverseorder, depending on the functionality involved, as would be understoodby those reasonably skilled in the art of the present invention.

The logic and/or steps represented in the flow diagrams of the drawings,which, for example, may be considered an ordered listing of executableinstructions for implementing logical functions, can be embodied in anycomputer-readable medium for use by or in connection with an instructionexecution system, apparatus, or device, such as a computer-based system,processor-containing system, or other system that can fetch theinstructions from the instruction execution system, apparatus, or deviceand execute the instructions. In the context of this document, a“computer-readable medium” can be any means that can contain, store,communicate, propagate, or transport the program for use by or inconnection with the instruction execution system, apparatus, or device.The computer readable medium can be, for example but not limited to, anelectronic, magnetic, optical, electromagnetic, infrared, orsemiconductor system, apparatus, device, or propagation medium. Morespecific examples (a nonexhaustive list) of the computer-readable mediumwould include the following: an electrical connection (electronic)having one or more wires, a portable computer diskette (magnetic), arandom access memory (RAM) (electronic), a read-only memory (ROM)(electronic), an erasable programmable read-only memory (EPROM or Flashmemory) (electronic), an optical fiber (optical), and a portable compactdisc read-only memory (CDROM) (optical). Note that the computer-readablemedium could even be paper or another suitable medium upon which theprogram is printed, as the program can be electronically captured, viafor instance optical scanning of the paper or other medium, thencompiled, interpreted or otherwise processed in a suitable manner ifnecessary, and then stored in a computer memory.

The above description and accompanying drawings depict the variousfeatures of the invention. It will be appreciated that the appropriatecomputer code could be prepared by a person who has ordinary skill inthe art to carry out the various steps and procedures described aboveand illustrated in the drawings. It also will be appreciated that thevarious terminals, computers, servers, networks and the like describedabove may be virtually any type and that the computer code may beprepared to carry out the invention using such apparatus in accordancewith the disclosure hereof.

Specific embodiments of an invention are disclosed herein. One ofordinary skill in the art will readily recognize that the invention mayhave other applications in other environments. In fact, many embodimentsand implementations are possible. The following claims are in no wayintended to limit the scope of the present invention to the specificembodiments described above. In addition, any recitation of “means for”is intended to evoke a means-plus-function reading of an element and aclaim, whereas, any elements that do not specifically use the recitation“means for”, are not intended to be read as means-plus-functionelements, even if the claim otherwise includes the word “means”.

Although the invention has been shown and described with respect to acertain preferred embodiment or embodiments, it is obvious thatequivalent alterations and modifications will occur to others skilled inthe art upon the reading and understanding of this specification and theannexed drawings. In particular regard to the various functionsperformed by the above described elements (components, assemblies,devices, compositions, etc.), the terms (including a reference to a“means”) used to describe such elements are intended to correspond,unless otherwise indicated, to any element which performs the specifiedfunction of the described element (i.e., that is functionallyequivalent), even though not structurally equivalent to the disclosedstructure which performs the function in the herein illustratedexemplary embodiment or embodiments of the invention. In addition, whilea particular feature of the invention may have been described above withrespect to only one or more of several illustrated embodiments, suchfeature may be combined with one or more other features of the otherembodiments, as may be desired and advantageous for any given orparticular application.

1. Portable electronic equipment, comprising a camera, a display,circuitry adapted to effect at least one of turning on or holding on thedisplay in response to recognizing a specified image provided by thecamera, wherein the camera is located in the equipment to face in adirection to view the face of a user of the equipment while the user isviewing the display, and further comprising a fish eye lens for thecamera to obtain a wide angle view to facilitate receiving an image ofthe face of a user of the equipment, wherein the fish eye lens has afocal length to provide to the camera a relatively focused image of theface of a user while such user holds the equipment in a hand during useof the equipment.